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We consider the FCFS GI/GI/n queue in the so-called Halfin- 
Whitt heavy traffic regime. We prove that under minor technical 
conditions the associated sequence of steady-state queue length dis- 
tributions, normalized by , is tight. We derive an upper bound 
on the large deviation exponent of the limiting steady-state queue 
length matching that conjectured by Gamarnik and Momcilovic in 
[14]. We also prove a matching lower bound when the arrival process 
is Poisson. 

Our main proof technique is the derivation of new and simple 
bounds for the FCFS GI/GI/n queue. Our bounds are of a struc- 
tural nature, hold for all n and all times t > 0, and have intuitive 
closed-form representations as the suprema of certain natural pro- 
cesses which converge weakly to Gaussian processes. We further illus- 
' trate the utility of this methodology by deriving the first non-trivial 

I bounds for the diffusion process studied in [26]. 

> 

^ 1. Introduction. Parallel server queueing systems can operate in a variety of regimes that 

balance between efficiency and quality of offered service. This is captured by the so-called Halfin- 
Whitt (H-W) heavy traffic regime, which can be described as critical with respect to the probability 
^ that an arriving customer has to wait for service. Namely, in this regime the stationary probability 

Q>^ , of wait is bounded away from both and 1, as the number of servers grows. Although studied 

I originally by Erlang [13] and Jagerman [17], the regime was formally introduced by Halfin and 

Whitt [15], who studied the GI/M/n system (for large n) when the traffic intensity scales like 
1 — Bn~2 for some strictly positive B. They proved that under minor technical assumptions on the 
, inter-arrival distribution, this sequence of GI/M/n queueing models has the following properties: 

(i) the steady-state probability that an arriving job finds all servers busy (i.e. the probability of 
wait) has a non-trivial limit; 

(ii) the sequence of queueing processes, normalized by na, converges weakly to a non-trivial 
positive recurrent diffusion; 

(iii) the sequence of steady-state queue length distributions, normalized by na, is tight and con- 
verges distributionally to the mixture of a point mass at and an exponential distribution. 

Similar weak convergence results under the H-W scaling were subsequently obtained for more 
general multi-server systems [23], [18], [20], [14], [26] with the most general results appearing in [26] 
(and follow-up papers [25], [24]). As the theory of weak convergence generally relies heavily on the 
assumption of compact time intervals, the most general of these results hold only in the transient 
regime. Indeed, with the exception of [15] (which treats exponential processing times), [18] (which 
treats deterministic processing times), and [14] (which treats processing times with finite support), 
all of the aforementioned results are for the associated sequence of normalized transient queue 
length distributions only, leaving many open questions about the associated steady-state queue 
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length distributions. 

In particular, in [14] it is shown for the case of processing times with finite support that the 
sequence of steady-state queue length distributions (normalized by nz) is tight, and has a limit 
whose tail decays exponentially fast. The authors further prove that this exponential rate of decay 
(i.e. large deviation exponent) is —2B{c\ + c|)~^, where B is the spare capacity parameter, and 
c^, c| are the squared coefficients of variation of the inter-arrival and processing time distributions. 
In [14] it was conjectured that this result should hold for more general processing time distributions. 
However, prior to this work no further progress on this question has been achieved. 

In this paper we resolve the conjectures made in [14] w.r.t. tightness of the steady-state queue 
length, and take a large step towards resolving the conjectures made w.r.t. the large deviation 
exponent. We prove that as long as the inter-arrival and processing time distributions satisfy very 
minor technical conditions (e.g. finite 2 + e moments), the associated sequence of steady-state 
queue length distributions, normalized by na, is tight. Under the same minor technical conditions 
we derive an upper bound on the large deviation exponent of the limiting steady-state queue length 
matching that conjectured by Gamarnik and Momcilovic in [14]. We also prove a matching lower 
bound when the arrival process is Poisson. 

Our main proof technique is the derivation of new and simple bounds for the FCFS GI/GI/n 
queue. Our bounds are of a structural nature, hold for all n and all times t > 0, and have intuitive 
closed-form representations as the suprema of certain natural processes which converge weakly to 
Gaussian processes. Our upper and lower bounds also exhibit a certain duality relationship, and 
exemplify a general methodology which may be useful for analyzing a variety of queueing systems. 
We further illustrate the utility of this methodology by deriving the first non-trivial bounds for the 
diffusion process studied in [26]. 

We note that our techniques allow us to analyze many properties of the GI/GI/n queue in the 
H-W regime without having to consider the complicated exact dynamics of the GI/GI/n queue. 
Interestingly, such ideas were used in the original paper of Halfin and Whitt [15] to show tightness 
of the steady-state queue length for the GI/M/n queue under the H-W scaling, but do not seem 
to have been used in subsequent works on queues in the H-W regime. 

The rest of the paper proceeds as follows. In Section 2, we present our main results. In Section 
3, we establish our general-purpose upper bounds for the queue length in a properly initialized 
FCFS GI/GI/n queue. In Section 4, we establish our general-purpose lower bounds for the queue 
length in a properly initialized FCFS M/GI/n queue. In Section 5 we use our bounds to prove the 
tightness of the steady-state queue length when the system is in the H-W regime. In Section 6 we 
combine our bounds with known results about weak limits and the suprema of Gaussian processes 
to prove our large deviation results. In Section 7 we use our bounds to study the diffusion limit 
derived in [26]. In Section 8 we summarize our main results and comment on directions for future 
research. We include a technical appendix in Section 9. 

2. Main results. We consider the First-Come-First-Serve (FCFS) GI/GI/n queueing model, 
in which inter-arrival times are independent and identically distributed (i.i.d.) random variables 
(r.v.s), and processing times are i.i.d. r.v.s. 

Let A and S denote some fixed r.v.s with non-negative support s.t. E[A] = < oo,E[S'] = 
//g^ < oo, and W{A = 0) = P(5' = 0) = 0. Let a\ and it| denote the variance of A and 5, respec- 
tively. Let c\ and c| denote the squared coefficient of variation (s.c.v.) of A and 5, respectively. 

We fix some excess parameter i? > 0, and let = n — Bn^ . For n sufficiently large to ensure 
An > (which is assumed throughout), let Q^{t) denote the number in system (number in service 
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+ number waiting in queue) at time t in the FCFS GI/GI/n queue with inter-arrival times drawn 
i.i.d. distributed as AX~^ and processing times drawn i.i.d. distributed as S (initial conditions will 
be specified later). All processes should be assumed right-continuous with left limits (r.c.1.1.) unless 
stated otherwise. All empty summations should be evaluated as zero, and all empty products should 
be evaluated as one. 

2.1. Main results. Our main results will require two additional sets of assumptions on A and S. 
The first set of assumptions, which we call the H-W assumptions, ensures that {Q^{t),n > 1} is in 
the H-W scaling regime as n — )• oo. We say that A and S satisfy the H-W assumptions iff fiA = fJ-s, 
in which case we denote this common rate by /i. The second set of assumptions, which we call the 
To assumptions, is a set of additional minor technical conditions we require for our main results. 

(i) There exists e > s.t. K[A'^+'],E[S'^+^] < oo. 

(ii) + c| > 0. Namely either yl or 5 is a non-trivial r.v. 

(iii) limsupt^o*~^IP('S' <t) <oo. 

(iv) For all sufficiently large n, Q^{t) converges weakly to a steady-state distribution Q^{oo) as 

t — > CXD. 

We note that technical condition (iii) of the Tq assumptions is not very restrictive, and is (for 
example) satisfied by any discrete distribution with no mass at zero, and any continuous distri- 
bution with finite density at zero. Furthermore, condition (iii) is in some sense natural, as certain 
closely related tightness results from the literature are known to require a similar condition (see 
the discussion in [34]). We refer the interested reader to [4] for an excellent discussion of technical 
condition (iv), which is also not very restrictive. 

We now state our main results. We begin by establishing the tightness of the steady-state queue 
length for the FCFS GI/GI/n queue in the H-W regime. 

Theorem 1. If A and S satisfy the H-W and Tq assumptions, then the sequence {[Q^{oo) — 
nj n 2 > 1} is tight. 

In words, the queue length ((5"(oo) — scales like 0(n2). 

We now establish an upper bound for the large deviation exponent of the limiting steady-state 
queue length for the FCFS GI/GI/n queue in the H-W regime, and a matching lower bound when 
the arrival process is Poisson. 

Theorem 2. Under the same assumptions as Theorem 1, 

limsupx~Mog limsupPf ((5"(oo) - n)"^?!"^ > X J < -2i?(c^ + c|)"^ 
If in addition A is an exponentially distributed r.v., namely the system is M/GI/n, then 



2B{c\ + cl)-\ 



lim X ^ log ( liminf p( ((5" (oo) — n)"*"?! 2 > a; ) 
lim x~^log I limsupPf {Q'^{oo) — n)~^n~2 > 



In words, Theorem 2 states that the tail of the hmiting steady-state queue length is bounded from 
above by exp ( — 2B{c\ + Cg)~^x + o(a;)) ; and when the arrival process is Poisson, the tail of the 
limiting steady-state queue length is bounded from below by exp ( — 2B{c\ + c|)~^x — o(a;)) , where 
o{x) is some non-negative function s.t. lim3;_).oo x~^o{x) = 0. Note that Theorem 2 translates into 
bounds for the large deviation behavior of any weak limit of the sequence {(Q"(oo) — n)^n~2 , n > 
1}, where at least one weak limit exists by Theorem 1. 

3. Upper bound. In this section, we prove a general upper bound for the FCFS GI/GI/n 
queue, when properly initialized. The bound is valid for all finite n, and works in both the transient 
and steady-state (when it exists) regimes. Although we will later customize this bound to the H-W 
regime to prove our main results, we note that the bound is in no way limited to that regime. For 
a non-negative r.v. X with finite mean M[X] > 0, let R{X) denote a r.v. distributed as the residual 
life distribution of X. Namely, for all z > 0, 

/"OO 

(1) P(i?(X) >z) = (E[X])-i / P(X > y)dy. 

J z 

Recall that associated with a r.v. X, an equilibrium renewal process with renewal distribution X 
is a counting process in which the first inter-event time is distributed as R{X), and all subsequent 
inter-event times are drawn i.i.d. distributed as X; an ordinary renewal process with renewal dis- 
tribution X is a counting process in which all inter-event times, including the first, are drawn i.i.d. 
distributed as X. Let {Ni{t),i = 1, . . . , n} denote a set of n i.i.d. equilibrium renewal processes with 
renewal distribution S. Let A{t) denote an independent equilibrium renewal process with renewal 
distribution A. 

Let Q denote the FCFS GI/GI/n queue with inter-arrival times drawn i.i.d. distributed as A, 
processing times drawn i.i.d. distributed as S, and the following initial conditions. For i = 1, . . . , n, 
there is a single job initially being processed on server i, and the set of initial processing times of 
these n initial jobs is drawn i.i.d. distributed as R{S). There are zero jobs waiting in queue, and the 
first inter-arrival time is distributed as R{A), independent of the initial processing times of those 
jobs initially in system. We now establish an upper bound for Q{t), the number in system at time 
t in Q. 

Theorem 3. For all x > 0, and t>0, 

F({Q{t) -n)+ > x) <f( sup {A{s) Ni{s)) > x] . 

\0<s<t J 

If in addition Q{t) converges weakly to a steady-state distribution Q{oo) as t — ?> oo, then for all 
X > 0, 

P((Q(oo)-n)+ > x) <f( sup {A{t) -S^ Ni{t)) > x] . 

V t>o ^ J 

Note that our bounds are monotone in time, as when t increases the supremum appearing in 
Theorem 3 is taken over a larger time window, and the bound for the steady-state is the natural 
limit of these transient bounds. 

We will prove Theorem 3 by analyzing a different FCFS G/GI/n queue Q which represents a 
'modified' FCFS GI/GI/n queue, in which all servers are kept busy at all times by adding artificial 
arrivals whenever a server would otherwise go idle. We note that our construction is similar to two 
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constructions appearing previously in the literature. In particular, in [7] the queue length of the 
G/GI /\ queue is bounded by considering a modified system in which the server goes on a vacation 
whenever it would have otherwise gone idle. In [15], the queue length of the GI/M/n queue is 
bounded by considering a modified system in which a refiecting barrier is placed at state n. 

We now construct the FCFS G/GI/n queue Q on the same probability space as {Ni(t),i = 
1, . . . ,n} and A{t). We begin by defining two auxiliary processes A{t) and Q{t), where A{t) will 
become the arrival process to Q, and we will later prove that Q{t) equals the number in system in Q 

at time t. Let tq = 0, {r^, k > 1} denote the sequence of event times in the pooled renewal process 

Mt) + Eti^iit)^ dA{t) = A{t) - A{t-), Ais,t) = A{t) - A{s), and dNi{t) = Ni{t) - N,{t-), 

Ni{s, t) = Ni{t) - Ni{s) for i = 1, . . . , n. 

We now define the processes A{t) and Q{t) inductively over {r^, k > 0}. Let A{tq) = 0, Q{to) = n. 
Now suppose that for some fc > 0, we have defined A(t) and Q{t) for all t < r^. We now define these 

processes for t E (r/fc,rfc+i]. For t € {t^jT^+i), let A{t) = ^(r^), and Q{t) = Q{tjS). Note that w.p.l 
dA{Tk+i) + Ya=i dNi{Tk+i) = 1, since R{A) and R{S) are continuous r.v.s, F{A = 0) = F{S = 0) = 
0, and A{t), {Ni{t),i = 1, . . . , n} are mutually independent. We define 



A{n+i) = 



Similarly, we define 



i(rfc) + l if d^(Tfc+i) = 1; 

i(rfc) + 1 if dm{Tk+i) = 1 and Q(rfc) < n; 

^l(rfc) otherwise (i.e. Yl'i=i dNi{Tk+i) = 1 and Q(rfc) > n). 



if dA{n+i) = l; 




Q{Tk+i) = { Q{Tk) if Er=i dm{Tk+i) = 1 and Q{Tk) < n; 

otherwise (i.e. XliLi dNi{Tk+i) = 1 and Q{Tk) > n) 

Combining the above completes our inductive definition of A[t) and Q{t). Since w.p.l limfe_>.oo7"fc = 
oo, it follows that w.p.l both A{t) and Q{t) are well-defined on [0, oo). We note that it also follows 

from our construction that w.p.l both A{t) and Q{t) are r.c.1.1., and define dA{t) = A{t) — A{t~). 

We now construct the FCFS G/GI/n queue Q using the auxiliary process A{t). Let denote 
the length of the jth renewal interval in process Ni{t),j > 1, i = 1, . . . , n. Then Q is defined to be 
the FCFS G/GI/n queue with arrival process A{t) and processing time distribution S, where the 
jth job assigned to server i (after time 0) is assigned processing time V^^^ for j > 1, i = 1, . . . , n. 
The initial conditions for Q are s.t. for i = 1, . . . ,n, there is a single job initially being processed 
on server i with initial processing time Vj^, and there are zero jobs waiting in queue. 

We now analyze Q, proving that 

Lemma 1. For i = 1, . . . , exactly one job departs from server i at each time t € {'Yl!'i=i ^ii3 — 
1}, and there are no other departures from server i. Also, no server ever idles in Q, Q{t) equals 
the number in system in Q at time t for all t > 0, and for all k > 1, 



(2) Qin) - n 



maxf 0,Q(rfc_i) -n + (i^(rfc) - ^dNi{Tk)\. 
^ i=i ' 



Proof. The proof proceeds by induction on {r/c,A: > 0}, with induction hypothesis that the 
lemma holds for all t < Tk- The base case k = follows from the the initial conditions of Q and 

5 



Q{t). Thus assume that the induction hypothesis holds for some fixed A: > 0. We first estabhsh the 
induction step for the statements about the departure process and non-idhng of servers. Let us fix 
some i G {1, . . . ,n}. By the induction hypothesis, server i was non-idhng on [0, r^], and the set of 
departure times from server i on [0, r^] was exactly {'^j^i = 1> • ■ ■ > -^j('^fc)}- We claim that the 
next departure from server i occurs at time ^i^i'''^'^^ Vj. Indeed, if Ni{Tk) = 0, the next departure 
from server i is the first departure from server i, which occurs at time V^. If instead Ni{Tk) > 0, 
then the last departure from server i to occur at or before time occured at time Xl/^i^'''* ^I- 
At that time a new job began processing on server i with processing time This job will 

depart at time Xl/^'i^'''*^^ verifying the claim. It follows that no server idles on {Tk,Tk+i), since 
^^i{T-fe)+i yi ^ [Tj,j > 1}, and thus > Tk+i- We now treat two cases. First, suppose 

^^j{-rfe)+i ^ Tk+i- Then there are no departures from server i on (r^, r^+i] and the induction step 
follows immediately from the induction hypothesis. Alternatively, suppose Yl^^''^^^ = Tk+i- In 
this case the next departure from server i occurs at time Tk+i, dNi{Tk+i) = 1, and all other servers 
are non-idling and have no departures on (rfe,Tfc+i]. Thus if there are at least n + 1 jobs in Q at 
time Tfc, then there are at least n + 1 jobs in Q at time t^^, and some job begins processing on 
server i at time t^+i. Alternatively, if there are exactly n jobs in Q at time r^, then Q{Tk) = n by 
the induction hypothesis. Thus dA{Tk+i) = 1, and this arrival immediately begins processing on 
server i. Combining the above treats all cases since there are at least n jobs in Q at time Tk by the 
induction hypothesis, completing the induction step. 

We now prove the induction step for the statement that Q{t) equals the number in system in Q 
at time t, as well as (2). Since we have already proven that any departures from Q on {Tk,Tk+i] 
occur at time t^+i, and by construction any jumps in A{t) and Q{t) on (Tfc,rfc occur at time 
Tfc+i, it suffices to prove that Q{Tk+i) equals the number in system in Q at time Tk+i- First, 
suppose (iyl(T^._|_i) = 1. Then ^^Li ^-^i('^A:+i) = 0, Q{Tjf) > n by the induction hypothesis, and 
Q{Tk+i) = Q{Tk) + 1. Thus 

m&y.[{},Q{Tk) - n + dA{Tk+i) -YA=i'^^i{'^k+i)) = max (O, (5(rfc) - ??, + l) 

= Q{Tk) -n + l = Q{Tk+i)-n, 

showing that (2) holds. Note that ELi = implies that Yd=i'''^^^ > ^k+i for aU 

i = and we have already proven that in this case there are no departures from Q on 

(rfc,rfc_|_i]. Since dA{Tk+i) = 1 implies dA{Tk+i) = 1, it follows that the number in system in Q at 
time Tk+i is one more than the number in system in Q at time Tk- Thus Qijk+i) equals the number 
in system in Q at time Tk+i by the induction hypothesis. 

Now suppose that Y^^=i d-^ii'^k+i) = 1- Then dA{Tk-^^l) = 0, and there exists a unique index i* 
^j^'*^^''^'''^ y.l = Tk+i- We have already proven that in this case there are no departures from 
Q on (t/s, rfc_|_i), and a single departure from Q at time Tk+i (on server i*). First suppose that there 
are at least n + l jobs in Q at time Tk- Then Q{Tk) > n -|- 1 by the induction hypothesis, and 
Q(Tfc+i) = Q(Tfc) - 1. Thus 

max(0,Q(rfc) -n-F(iA(rfc+i) -X]"^^(iiVi(Tfc+i)) = max (O, Q(rfc) - n - l) 

= Q{Tk)-n-l = Q{Tk+i)-n, 

showing that (2) holds. Since dA{Tk+i) = 0, there are no arrivals to Q on {Tk,Tk+i]- Combining the 
above, we find that the number in system in Q at time Tk+i is one less than the number in system 
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in Q at time Tfc. Thus Q{Tk+i) equals the number in system in Q at time Tk+i by the induction 
hypothesis. 

Alternatively, suppose that J2i=i = 1 and there are exactly n jobs in Q at time r^. 
Then Q{Tk) = n by the induction hypothesis, and (^(Tfc+i) = Q{Tk). Thus 

ms.y.{^,Q{Tk) -n + dA{Tk+i) -Y,'l^^dNi{Tk+i)) = max (O, Q(rfc) - n - l) 

= = Q{Tk+i) - n, 

showing that (2) holds. Since dA{Tk+i) = 1, there is a single arrival to Q on {Tk,Tk+i]- Combining 
the above, we find that the number in system in Q at time t^+i equals the number in system 
in Q at time r^. Thus Q{Tk+i) equals the number in system in Q at time Tk+i by the induction 
hypothesis. Since Q{Tk) > nhy the induction hypothesis, this treats all cases, completing the proof 
of the induction and the lemma. □ 

We now 'unfold' recursion (2) to derive a simple one-dimensional random walk representation 
for Q{t). We note that the relationship between recursions such as (2) and the suprema of asso- 
ciated one-dimensional random walks is well-known (see [6], [7]). Then it follows from (2) and a 
straightforward induction on {t^, k >0} that w.p.l, for all k >0, 

Q{Tk) -n = m&x^ (^A{Tk-j,Tk) - Ni[Tk-j,Tk)^ . 

As all jumps in Q{t) occur at times t S {r^, k > 1}, it follows that 
Corollary 1. W.p.l, for all t>0, 

Q{t)-n = sup (Ait-s,t)-y^Ni{t-s,t)\. 

o<s<t \ fr^ J 

We now prove that Q{t) provides an upper bound for Q{t). 

Proposition 1. Q{t) and Q{t) can he constructed on the same probability space so that w.p.l 
Q{t) < Q{t) for all t > 0. 

For our later results, it will be useful to first prove a general comparison result for G/G/n 
queues. Although such results seem to be generally known in the queueing literature (see [33], [29]), 
we include a proof for completeness. For an event E, let I{E) denote the indicator function of E. 

Lemma 2. Let Q} and be two FCFS G /G /n queues with finite, strictly positive inter-arrival 
and processing times. Let {T|, k >\} denote the ordered sequence of arrival times to Q*, i S {1,2}. 
Let S\ denote the processing time assigned to the job that arrives to Q* at time T^, A; > 1, i G {1, 2}. 
Further suppose that 

(i) The initial number in system in Q} is at most n; 

(a) For each job J initially in there is a distinct corresponding job J' initially in s.t. the 

initial processing time of J in equals the initial processing time of J' in Q^; 
(Hi) {T^,k > 1} is a subsequence of {T^,k > 1}; 

(iv) For all k > 1, the job that arrives to at time is assigned processing time Sj,, the same 
processing time assigned to the job which arrives to Q} at that time. 
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Then the number in system in at time t is at least the number in system in at time t for 
all t > 0. 

Proof. Let Z^{t) denote the number of jobs initiahy in which are stih in at time t, 
i G {1,2}. We claim that Z^{t) > Z^{t) for ah t > 0. Indeed, let J be any job initially in Q^, and 
let Sj denote its initial processing time. Then (ii) ensures the existence of a distinct corresponding 
job J' initially in Q^, with the same initial processing time Sj. Since by (i) all jobs initially in 
begin processing at time 0, it follows that J departs at time Sj, while J' departs no earlier 
than Sj. Making this argument for each job J initially in proves that Z'^{t) > Z^{t) for all 
t > 0. 

Let D\ denote the time at which the job that arrives to Q* at time departs from Q^, k > 
l,i € {1,2}. We now prove by induction that for A; > 1, D"^ > D\, from which the proposition 
follows. Observe that for all A; > 1, 

fc-1 

(3) Dl = inf{t : t>Tl Z\t) + J] I{D] > t) < n - 1} + 5^ 

i=i 

Also, 

fc-1 

(4) Dl>ini{t: t > T^, Z\t) + ^I{D] > t) < n - 1} + Sl, 

i=i 

where the inequality in (4) arises since Z'^it) > Z^{t) for all t > 0, and the job that arrives to 
at time may have to wait for additional jobs, which either were initially present in but not 
Q^, or which arrive at a time belonging to {T^.k > l} \ {Tl,k > 1). 

For the base case fc = 1, note that D\ = inf{t : t > T/, < n - 1} + S\, while Dl > inf{t : 

t>Tl,Z^{t) <n-l} + Sl. 

Now assume the induction is true for all j < k. Then for all t > 0, X^j=i ^i^j > i) ^ 
E-=i/(^]>i)-Thus 

k 

mf{t : t > Tl^^,Z\t) + KD} >t)<n-l] + Sl^, 

fc 

< inf{t : t > Tfci+i, Z\t) + > t) < n - 

i=i 

It then follows from (3) and (4) that DI^^ < completing the 

We now complete the proof of Proposition 1. 

Proof of Proposition 1. We construct Q and Q on the same probability space. We assign Q 
and Q the same initial conditions, and let A{t) be the arrival process to Q on (0, oo). Let {tk, k > 1} 
denote the ordered sequence of event times in A{t). It follows from the construction of A{t) that 
{ifc; A: > 1} is a subsequence of the set of event times in A{t). We let the processing time assigned 
to the arrival to Q at time tk equal the processing time assigned to the arrival to Q at time tk, 
A; > 1. It follows that w.p.l Q and Q satisfy the conditions of Lemma 2. Combining the above with 
Lemma 1 completes the proof. □ 
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l} + 5fc+i- 

induction. □ 



We now complete the proof of Theorem 3. 



Proof of Theorem 3. By elementary renewal theory (see [9]), A(s)o<s<t has the same distri- 
bution (on the process level) as A(t — s,t)^^^^^, and -^i(*)o<s<t has the same distribution 
(on the process level) as Y17=i'^i{^ ~ *'*)o<s<i' Combining with the independence of A{t) and 
Y17=i^ii^)^ Corollary 1, and Proposition 1, proves the theorem. 

We now prove the corresponding steady-state result. Note that for any x > 0, the sequence of 
events | supo<^<f (^(■s) — Sr=i -^«(*)) > a;,* > 0| is monotonic in t. It follows from the continuity 
of probability measures that 



lim f( sup (A{s) - ViVi(s)) > x^ = pf sup (A{t) -f" Ni{t)) 

\0<s<t J \t>0 1^1 



> X 



The steady-state result then follows from the corresponding transient result and the definition of 
weak convergence, since Q{oo) has integer support. □ 

4. Lower bound. In this section, we prove a general lower bound for the M/GI/n queue, when 
properly initialized. Suppose A is an exponentially distributed r.v. Let Z denote a Poisson r.v. with 
mean Let Q2 denote the M/GI/n queue with inter-arrival times drawn i.i.d. distributed as A, 
processing times drawn i.i.d. distributed as S, and the following initial conditions. At time there 
are Z jobs in system. This set of initial jobs have initial processing times drawn i.i.d. distributed 
as R{S), independent of Z . li Z > n, a set of exactly n initial jobs is selected uniformly at random 
(u.a.r.) to be processed initially, and the remaining initial jobs queue for processing. Suppose 
also that the first inter-arrival time is distributed as R{A) (also an exponentially distributed r.v.) 
independent of both Z and the initial processing times of those jobs initially in the system. Recall 
the processes A{t) and {Ni{t),i = 1, . . . ,n}, which were defined previously at the start of Section 
3. Then Q2{t), the number in system at time t in Q2, satisfies 

Theorem 4. For all x > 0, and t >0, 

n 

P(((52(i) - n)+ > x) > P(Z > n) sup F{A{s) - V Ni{s) > x) . 

0<s<t , 
— — %=\ 

If in addition Q2{i) converges weakly to a steady-state distribution Q{oo) as i — ?• 00, then for all 
X > 0, 

n 

P((Q(oo) - n)+ > x) > P(Z > n) supP(^(t) - ViVi(t) > x). 

t>o ^ 

Comparing with Theorem 3, we see that our upper and lower bounds exhibit a certain duality, 
marked by the order of the P and sup operators. 

We will prove Theorem 4 by coupling Q2 to both an associated FCFS M/GI / 00 queue Qoo and 
a certain family of FCFS G/G/n queues {Q,2^s > 0}. For each s > 0, our coupling ensures that 
(5|(t), the number in system at time t in Q|, provides a lower bound for Q2{t) for all t > s, and 
that the set of remaining processing times (at time s) of those jobs in Q| at time s is a random 
thinning of the set of remaining processing times (at time s) of those jobs in at time s. We 
note that some of the ideas involved in the proof of our lower bound have appeared in the literature 
before (see [30], [29], [35]). 
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We now construct Qoo and {Q2,s > 0}. We assign Qoo the same initial conditions as Q2 (although 
in Qoo all initial jobs begin processing at time 0). We let Qoo and Q2 have the same arrival process, 
and for each arrival, we let the processing time assigned to this arrival to Qoo equal the processing 
time assigned to this arrival to Q2- 

We now describe the initial conditions and arrival process for Q^ in terms of an appropriate 
thinning of the initial conditions and arrival process of Qoo, where the nature of this thinning 
depends on Qoo(s), the number in system at time s in Qoo- If Qoo{s) < n, then the initial conditions 
of Q2 are to have zero jobs in system, and the arrival process to Q| is to have zero arrivals on 
[0,00). If Qoois) > n, then we select a size-n subset of jobs u.a.r. from all subsets of the jobs 
being processed in Qoo at time s. Let Cq denote those jobs in which were initially in Qoo at time 
0. Then the initial conditions of Q| are as follows. For each job J € Cq, there is a corresponding job 
J' initially in Ql, where the initial processing time of J' in Q^ equals the initial processing time of 
J in Qoo- There are no other initial jobs in Q|. The arrival process to Q| on (0, s] is as follows. For 
each job J that arrives to Qoo (and thus to Q2) on (0, s], say at time r, there is a corresponding 
arrival J' to Q| at time r iff J S C'^ \ Cq. In this case, the processing time assigned to J' in Q| 
equals the processing time assigned to J in Qoo. There are no other arrivals to Ql on (0, s]. We let 
Q21 Qooi and Q2 have the same arrival process on (s, 00), and for each arrival, we let the processing 
time assigned to this arrival to Q^ equal the processing time assigned to this arrival to Qoo (and 
thus Q2). 

We claim that our coupling of Qoo to Q2 and construction of Q^ ensure that Ql and Q2 satisfy 
the conditions of Lemma 2. Indeed, for each job initially in Q|, there is a distinct corresponding 
job initially in Q2 with the same initial processing time. Also, for each job that arrives to Q|, there 
is a distinct corresponding job that arrives to Q2 at the same time with the same processing time. 
Thus w.p.l Q2{t), the number in system at time t in Q|, satisfies 

(5) Q2(i) > Q!(i) for all s,t>0. 

We now complete the proof of Theorem 4. 

Proof of Theorem 4. Since Qoo is initialized with its stationary distribution (see [32]), it 
follows from the basic properties of the M/GI/00 queue (see [32]) that P((5oo(s) > n) = ¥{Z > n), 
and conditional on the event {Qoois) > n}, the set of remaining processing times (at time s) of 
those jobs being processed in Qoo at time s are drawn i.i.d. distributed as R{S). Thus conditional 
on the event {Qoo{s) > n}, one has that |C*] = n, and the set of remaining processing times (at 
time s, in Qoo) of those jobs belonging to C* is drawn i.i.d. distributed as R{S). 

By construction the number of jobs initially in Q^ at time plus the number of jobs that arrive 
to Q| on (0, s] is at most n. Thus all jobs initially in Q^ at time and all jobs that arrive to Q^ 
on (0, s] begin processing immediately in Q|, as if Q| were an infinite-server queue. It follows from 
our construction that conditional on the event {Qoo('S) ^ n}, the set of remaining processing times 
(at time s) of the n jobs in Q| at time s equals the set of remaining processing times (at time s, in 
Qoo) of those jobs belonging to C*, and are thus drawn i.i.d- distributed as R{S). 

Let us fix some s, t s.t. < s < t. Recall that V-^ denotes the length of the jth renewal interval 
in process Ni{t),j > l,i = 1, . . . ,n. It follows from our construction that conditional on the event 
{Qoois) > n}, we may set the remaining processing time (at time s) of the job on server i in 
Q| at time s equal to V^^. We can also set the processing time of the jth job assigned to server 
i in Q| (after time s) equal to V/^ . Under this coupling the total number of jobs that depart 
from server i in Ql during [s,t] is at most Ni{t — s), and therefore the total number of departures 
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from 0,2 during is at most X]"^^ — •§), independent of the arrival process to on [s,t]. 
By the memoryless and stationary increments properties of the Poisson process, we may let the 
arrival process to on [s,t] equal A(v)Q<,n<t-s- Combining the above, we find that for all x > 0, 
P(Q|(i) - n> x)> P(Z > n)P(^(t - s) - Er=i^»(* " > Observing that s was general, 
we may then take the supremum of the above bound over all s G [0, t], and combine with (5) to 
complete the proof of the theorem. The corresponding steady-state result then follows from the 
fact that monotonic sequences have limits and the definition of weak convergence. □ 

5. Tightness and proof of Theorem 1. In this section, we prove Theorem 1. We note that 
it follows almost immediately from Theorem 3 and well-known tightness results from the literature 
(see [5] Theorem 14.6, [36] Theorem 7.2.3) that for any fixed T > 0, {n~2 {Q"'{t) — "')(^<4<t! n > 1} 
is tight in the space £'[0, T] under the Ji topology (see Subsection 6.1 for details). The challenge 
is that when analyzing {n~2 (Q"(oo) — n) , n > 1}, one does not have the luxury of bounded time 
intervals. In particular, to apply Theorem 3, we must show tightness of a supremum taken over an 
infinite time horizon. For this reason, most standard weak convergence type results and arguments 
from the literature (see [36]) break down, and cannot immediately be applied. Instead, we will 
relate the supremum appearing in the r.h.s. of Theorem 3 to the steady-state waiting time in an 
appropriate G/D/1 queue with stationary (as opposed to i.i.d.) inter-arrival times. We will then 
apply known results from the literature, in particular [31], to show that under the H-W scaling this 
sequence of steady-state waiting times, properly normalized, is tight. 

Suppose that assumptions H-W and Tq hold. Let An{t) = A{Xnt). In light of Theorem 3, it suffices 
to prove that {n~ 2 snp^^Q [An{t) — "^{=1 Ni{t)) , n > 1} is tight. Let A^(t) denote an ordinary 
renewal process with renewal distribution AX~^, independent of {Ni{t),i = l,...,n}. Note that 
we may construct An{t) and A'^{t) on the same probability space so that Anit) < 1 + ^° (i) for all 
t > 0. It thus suffices to demonstrate the tightness of {n~2 sup4>o {A^{t) — Y17=i -^j(^)))'^ ^ !}• 

Let {Aj,i > 1} denote a countably infinite sequence of r.v.s drawn i.i.d. distributed as A, 
independent of {Ni{t),i = 1, . . . , n}. Note that since A^{t) — X]r=i -^«(^) ^^^Y increases at jumps of 
A^{t), we may construct A^(t), Y17=i ^ii'^)^ {^i )^ — 1} the same probability space so that 

n n k 

(6) n-i sup (^O(t) - N,{t)) = n--2 sup {k - ^ iV,(A-i ^ 4)) . 
We now show that 

n k 

(7) {n-^ sup {k-J2 NiiK' ^D) ' ^ 1} 

is tight, which (by the above) will imply Theorem 1. Fortunately, the tightness of such sequences 
of suprema has already been addressed in the literature, in the context of steady-state waiting 
times in a G/G/1 queue, with stationary inter-arrival times, in heavy-traffic. In particular, note 
that for M > 1, supo<fc<j\./ {k — Yl^=i ^ii^n^ Yl^=i '^])) corresponds to the waiting time of the 
(M -|- l)st arrival to a G/D/1 queue, initially empty, with all processing times equal to 1, and the 
kth inter-arrival time equal to 

n M-k Af-fe+1 

i=l j=l j=l 
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Recall that -^i(i)t>o has the same distribution (on the process level) as X^"=i-/Vj(t — 

'^'^)o<s<i (^^^ [^])' i^h''' — 1} i-i-^- -'^^ follows that for all M > 1, supo<fc<M ~ 
Y17=i ^ii'^n^ Si=i ^j)) same distribution as the waiting time of the (M + l)st arrival 

to a G/D/1 queue, initially empty, with all processing times equal to 1, and the kth inter-arrival 
time equal to 

n fc— 1 k 

i=l j=l j=l 

For this queueing model, in which the sequence of inter-arrival times is stationary, one can ask 
whether there is a meaningful notion of steady-state waiting time, whose distribution would natu- 
rally coincide with that of 

n k n k 

hm sup (A;-^iV,(A-i =sup(fc-^iV,(A-iJ]yl])). 

Furthermore, should one examine a sequence of such queues in heavy traffic, one can ask whether 
the corresponding sequence of steady-state waiting times, properly normalized, is tight. 

Note that as (7) is such a sequence, we are left to answer exactly this question. Fortunately, 
sufficient conditions for tightness of such a sequence are given in [31]. In particular, as we will 
show, it follows from the results of [31] (in the notation of [31]) that 

Theorem 5. Suppose that for all sufficiently large n, {Cn,*,^ > 1} is a stationary, count- 
ably infinite sequence of r.v. Let a„ = E[C„^i], and Wn,k = Z^f=iCn,i- Further assume that a-n < 
0, lim„_j.oo On = 0, and there exist Ci, C2 < oo and e > s.t. for all sufficiently large n, 

(i) ^[\Wn,k - A;a„|2+^] < Cifc^+t for all k > 1; 

(a) P(maXj=i^...^fc(VFn^j - ia„) > x) < C2k^^^x~^'^~^''^ for all k > 1 and x > 0. 
Then {\an\ snp^^Q Wn^k^n- ^ 1} is tight. 

Proof. The proof follows from Theorem 1 of [31], and is deferred to the appendix. □ 

To verify that the assumptions of Theorem 5 hold for 

n k 

sup (A: - ^ iV:,(A^i A])) , n > 1}, 

'^-O i=l j=l 

we will rely on a technical result from [5], which gives a bound on the supremum of a general 
random walk in terms of bounds on its increments. In particular, it is shown in [5] Theorem 10.2 
that 

Lemma 3. Suppose k < 00, Xi,X2, ■ ■ ■ , is a sequence of general (possibly dependent and not 
identically distributed) random variables, Sj = "^{^iXi, and = maxj<fc ISjl. Further suppose 
that there exist real numbers a > ^, (3 > 0, and a sequence of non-negative numbers ui,U2, . . . ,Mfc 
s.t. for all < i < j < k and x > 0, 

mS,-S,\>x)<x-^f^{ n,)'" 

i<i<j 
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Then there exists a finite constant K^^p, depending only on a and (3, s.t. for all x > 0, 

0<l<k 

We will also use frequently the inequality 

(8) (xi + X2y < 2'-^x\ + 2'-^x^2 for all r > 1 and xi,X2> 0, 

which follows from the convexity of f{x) = x^ , r > 1. 

Before proceeding with the proof of Theorem 1, we establish two more auxiliary results. The first 
bounds the moments of the sum of n i.i.d. zero-mean r.v. in terms of the moments of the individual 
r.v.s. and n, and is proven in [37]. 

Lemma 4. For all r > 2, there exists < oo (depending only onr) s.t. for all r.v. X satisfying 
E[X] = and E[\X\^] < oo, if {Xi,i > 1} is an i.i.d. sequence of r.v.s distributed as X, then for 
all k > 1, 

k 

m^^ill < Crkm[\x\'']. 

i=l 

Second, we prove a bound for the central moments of a pooled equilibrium renewal process. 

Lemma 5. Let X denote any non-negative r.v. s.t. K[X] = fj,~^ G (0, oo), and K[X^] < oo for 
some r > 2. Let {Zf{t),i > 1} denote a set of i.i.d. equilibrium renewal processes with renewal 
distribution X. Then there exists Cx,r < oo (depending only on X and r) s.t. for all n > 1 and 
t > 0, 

(9) E[|f]Zf(t)-^ntr] <Cx,.(l + (nt)§). 

1=1 

Proof. The proof is deferred to the appendix. □ 
With the above bounds at our disposal, we now complete the proof of Theorem 1. 
Proof of Theorem 1. In the notation of Theorem 5, let 

n fc— 1 k 

^ 1 - 5^ iV. ( 5] yl] , A- 1 ^] ) , 

i=i j=i j=i 

n k 
Wn,k = k-Y,N^{^-'Y.A]). 

i=l j=l 

That {Cn,i,i > 1} is a stationary, countably infinite sequence of r.v. follows from the stationary 
increments property of the equilibrium renewal process. Since ^[^^=1 Xi{t)] = ntfi for all t > 0, 

it follows that a„ = E[^„^i] = 1 — = ^ — < 0, and lim„_>,oo o-n = 0. Thus we need only 
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verify assumptions (i) and (ii) of Theorem 5. Since E[74^"'"^], EfS"^^*^] < oo for some e > by the Tq 
assumptions, we may fix some r > 2 s.t. E[^^],E[S"'] < oo. Note that 



'n,fc ro""n\ 



n k J 

■ 1 • 1 " 

1=1 J=l 



( fL k k k J \ r 

I Y: E 4) - E ^] I + l/^f E ^] - I ) ] by the tri. ineq. 



n k k 

(10) < 2-iE[|^iV^(A-ij;A])-/.f ^^]r] 

(11) +2^-^IE[|^f ^^}-^r] by (8). 

We now bound (10). By Lemmas 4-5, there exist Cs,r,Cr < oo independent of n and k s.t. 

n k k k 

IE[lE^^(^n'E^])-/^f E^n < Cs,r + CsA^)HiY.^j)'] byLemmaS 

j=l j=l _; = ! j=l 



< Cs,r + Cs,.(f )5E[f I E (^] - ^-') I + ^^-'1 '] 

< Cs,r + CsA^f^ f 2§-iE[| E [A] - ^,-^)\^ + 25-^(fc/.-i) 

^Jl \ -I 
k 

< C5,. + 2i-iC5,.(£-)5('E^[|^(^]-/."i)r] +(A;/.-^)i') 

since E,[X] < E2 [X^] for any non-negative r.v. X 

< Cs,r + 25-iC5,.(^)5 (^(aA:iE[|^ - ^"Y])^ + (A:/^"')^) 

by Lemma 4. 

(12) < C{A;i 

for some finite constant C[ independent of n and k, since E[|A — ] < 00, and hm„_s.oo x" ~ 1" 
We now bound (11). 

^O^f E4-^r] = (f )VE[iE(^]-A^-^)r] 

< (^CriyYu^'EllA- fi-^l'-j^k^ by Lemma 4 
(13) < CfA:2 for some finite constant Ci independent of n and k. 

Using (12) to bound (10) and (13) to bound (11), it foUows that assumption (i) of Theorem 5 

holds for the finite constant Ci = 2'''-^{C[ + C'{). We now apply Lemma 3 to show that assumption 
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(ii) holds as well. In the notation of Lemma 3, let Sn,i = W^^i — ia-n for i > 0, and M^^k = 
maxj<^. \Wn,i — idnl for k > 0. Then for all n, < i < j, and x > 0, 

^{\Sn,j — Sn,i\ > x) = P(|5„j_i| > x) by stationary increments 

= ¥{\Wn,J-^ - {j - i)an\ > X) 

< Ci(j — i)^x~''' by Markov's inequality 

Thus for all n and A; > 1, we may apply Lemma 3 (in the notation of Lemma 3) with /3 = ^, a = |, 

and ui = (Ci + 1) for 1 < Z < fc, to find that there exists a constant Kr < oo (depending only on 
r) s.t. for all x > 0, 

(14) P( max^{Wn,i - ian) > x) < Kr{Ci + l)5fc5rE-^ 

It follows that assumption (ii) of Theorem 5 holds as well, with (in the notation of Theorem 5) 

C2 = Kr{Ci + 1)2, e = r — 2. Combining the above, we find that all assumptions of Theorem 5 
hold, and thus we may apply Theorem 5 to find that 

I sup {k-j2 mK' E ^])) ' ^ ^ 4 

[n2-Bk>o ^ p{ ' J 

is tight. Combining with (6) completes the proof of Theorem 1. □ 

6. Large deviation results and proof of Theorem 2. In this section, we complete the 
proofs of our main results. We proceed by combining our upper and lower bounds with several known 
weak convergence results for (pooled) renewal processes and the suprema of Gaussian processes. 
Recall that a Gaussian process on R is a stochastic process Z(t)t>o s.t. for any finite set of times 
ti,...,tk, the vector (^Z(ti), . . . , Z{tk)) has a Gaussian distribution. A Gaussian process Z{t) is 
known to be uniquely determined by its mean function E[Z(t)] and covariance function K[Z{s)Z{t)], 
and refer the reader to [11], [16], [2], [21], and the references therein for details on existence, continuity, 
etc. 

6.1. Preliminary weak convergence results. In this subsection we review several weak conver- 
gence results for renewal processes, and apply them to An{t) and Y17=i -^ii^)- excellent 
review of weak convergence, and the associated spaces (e.g. D[0,T]) and topologies/metrics (e.g. 
uniform, Ji), the reader is referred to [36]. Let A{t) denote the w.p.l continuous Gaussian process 
s.t. E[A{t)] = 0,E[A{s)A{t)] = ^ic\mm{s,t), namely A{t) is a driftless Brownian motion. Then it 
follows from the well-known Functional Central Limit Theorem (FCLT) for renewal processes (see 
[5] Theorem 14.6) that 

_ 1 

Theorem 6. For any T G [0,oo), the sequence of processes {An ^ {An{t) — An/zt)^^^^^, n > 1} 
converges weakly to ^(t)o<t<T in the space D[0,T] under the Ji topology. 

We now give a weak convergence result for X^^Li -/Vj(t), which is stated in [36] (see Theorem 
7.2.3) and formally proven in [34] (see Theorem 2). 
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Theorem 7. There exists a w.p.l continuous Gaussian process ^{t) s.t. W{D{t)] = 0, E[P(s)P(t)] = 
E[(A^i(s) — /is) (yNi{t) — fit)] for all s,t > 0. Furthermore, for any T S [0, oo), the sequence of pro- 
cesses {n'~2(^Yl^=iNiit) — "'/^Oo<t<T'"' — ^J" converges weakly to V{t)o<t<T in the space D[0,T] 
under the Ji topology. 

We note that the Tq assumptions (i) and (hi), which guarantee that E[S'^~*"^] < cxd and hmsup^jig x~^W{S < 
x) < oo, ensure that the technical conditions required to apply [36] Theorem 7.2.3, namely that 
EIS"^] < oo and limsup^^o ^"^'^'('S' < - ^(S = 0)) < oo, hold. 

It follows from Theorems 6-7 that 

Lemma 6. For any fixed T > 0, {n~2 — Y17=i -^*(*))o<i<r' — converges weakly to 

{A{t) - V{t) - Bfit)^^^^^^ in the space D[0,T] under the Ji topology. 

Proof. Note that 

1 " / 1 1 „i " 1 \ 

n~^2{An{t)-^Ni{t))^^^^^ = [Xln^l{An{t)-\nHt)Xn^ -{^Ni{t)-n^it)n-^ -Bfit) 

i=l - - V / 0<t<T 

The lemma then follows from Theorems 6-7. □ 

We note that a process very similar to {A{t) - V{t) - But)^^^^^, was studied in [34] as the weak 
limit of a sequence of queues with superposition arrival processes. The continuity of the supremum 
map in the space D[0,T] under the Ji topology (see [36] Theorem 13.4.1), combined with Lemma 
6, implies that 

Corollary 2. For any fixed T > 0, {n~^ supo<t<T {An{t) - ^i=iNi{t)),n > 1} converges 
weakly to the r.v. supo<«T {A{t) — T>{t) — B^t^. 

6.2. Preliminary large deviation results. Before proceeding with the remaining proofs, we will 
need to establish some results from the theory of large deviations of Gaussian processes and their 
suprema. We note that the relationship between the suprema of Gaussian processes and queueing 
systems is well known (see [12]). We will rely heavily on the following theorem, proven in Section 
3.1 of [12]. 

Theorem 8. Suppose Z{t) is a Gaussian process with stationary increments s.t. E.[Z{t)] = 
for all t>0, and lim^^oo t~^E[Z'^{t)] = > 0. Then for any c> 0, 

lim x-^\og fP(sup(2(t) -ct) > x)] = 
x^oo V i>o / o- 

It is also implicit from [12] (although we include a short proof) that 

Theorem 9. Under the same assumptions as Theorem 8, for any c > 0, 

lim x'Mog I supP(Z(t) -ct> x)] = 



16 



Proof. That hmsup^^o^x ^ log ^ supj>Q P(Z(t) — ct > x)^ < — ^ follows immediately from 
Theorem 8 and the fact that sup^g F(^Z{t) — ct > x) < P^sup4>o {Z{t) — ct) > . 



Letting t = ^, we find that 



(15) supP(Z(t) -ct> x) > F(Z{-) -x> x). 

t>0 c 

Let G denote a normally distributed r.v. with mean and variance 1. Then since Z{^) is normally 
distributed with mean zero, it follows from (15) that 



(16) 



supP(Z(t) -ct> x) >f(g > 2xE-5 [Z^{-)] ] . 
t>0 \ c / 



We use the following identity from [1] Equation 7.1.13. Namely, for all y > 0, 

P(G >y)>{y + {y^ + 4)-5)-\^)^ exp(-^). 

Thus 

(17) F(G > y) > exp(— — y) for all sufficiently large y. 

By assumption, limt_^oo i~^lE[2^(t)] = fx^ > 0, and thus lim^^-^oo 2xE~2 [^^^-^-^j _ ^]^^g 
follows from (16) and (17) that for all sufficiently large x, 

x~^log ( supP(Z(t) -ct > x) ) >-2xE~^\Z^(-)] -2E~^\Z'^(-)]. 
\t>o J ^ c ' ^ c ' 

Since lima;_^oo(f )~^IE[2:2(|)] = a^, it follows that liminf^^^^oo a;"^ log ^ supt>o P(^(t) - ct > x)^ > 
concluding the proof of the theorem. □ 

In light of Theorem 8, Theorem 9 can be interpreted as saying that such a process is 'most likely' 
to exceed a given value x at a particular time (roughly | ) , and much less likely to exceed that value 
at any other time (see the discussion in [12]). We note that the duality of Theorems 8-9 coincides 
with the duality exhibited by our upper and lower bounds (Theorems 3 - 4) - a relationship that 
we will exploit to prove our large deviation results. 

We are now in a position to apply Theorems 8 - 9 to A{t) — T>{t). 
Corollary 3. 

(i) lim^^ooa;-^ logp(^supi>o (^W - ^(0 " Bjit) > x^ = -2B{c\ + cl)"^ ; 

(ii) lim^^ooX-Mog supt>o P(^(t) - P(t) - > x)^ = -2B{c\ + 0%)-^ . 
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Proof. That A{t) — T){t) is a zero-mean Gaussian process with stationary increments follows 
from definitions, the independence of A{t) and T>{t), and the fact that both A{t) and Ni{t) have 
stationary increments. Note that 

(18) E[{A{t) - V{t))^] = fic\t + E[{Ni{t) - fit)% 



We claim that liuit^oot ^IE[(A^i(t) — /Ut)^] = fxcg. Indeed, let Gs denote a normally distributed 
r.v. with mean and variance /ic|. It follows from the well-known Central Limit Theorem for 

renewal processes (see [28] Theorem 3.3.5), and the fact that h{z) = is a continuous function, that 

the sequence of r.v.s { (^^^ (-^i(*) ~/"*)^ ,t > 1} converges weakly to G|. Recall that E[5'^"'"^] < oo 

for some e > by the Tq assumptions. Thus it follows from Lemma 5 that the sequence of r.v.s 

{ (iVi(t) - fj,t)^ , t > 1} is uniformly integrable. It follows that limt^^oo t~^E[(iVi(t) - //i)^] = 

/ic|, since uniform integrability plus weak convergence implies convergence of moments. 

Combining with (18), we find that liuit^oo t~'^E[{A{t) - P(t))^] = n{c\ -h c|) > by the Tq 
assumptions. It follows that A{t) — V{t) satisfies the conditions needed to apply Theorems 8-9, 
from which the corollary follows. □ 

6.3. Proof of Theorem 2. Before completing the proofs of our main results, it will be useful to 
prove a strengthening of Theorem 1. Namely, 

Lemma 7. For all x > 0, 
(19) lim limsuppfn-5 sup M„(t) - ViV^Xt)) > = 0. 

— i=\ ^ 

Proof. Since E[A^"'"^], E[S'^'^'^] < oo for some e > by the Tq assumptions, we may fix some 
r > 2 s.t. E[AT,E[5"'] < oo. Note that since x > 0, P^n'^ supi>r (A„(t) - Ya=\ ^i(*)) > ^ is at 

most P^n^2 supo-r (A„(t) — X^"^^ -^«(*)) > • -^y ^ simple union bound, P^n~2 supj>^ (^n(i) — 

Y2=\ ^ii*)) > is at most 



(20) 
(21) 



/ B \ 

p n-2(A„(r)-^iv,(r)) >--/.r 
^ i=i ^ 

+p|^sup {n-\[A^{t) -f2N,{t))-n"2{An{T) - ^iV,(r))) > |/.rj , 
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We now bound (20), which equals 



B \ 

1=1 ^ ^ 

< P^|A„(r) - A„/xr| + \Y2Ni{T) - ni^LT\ > n^2^fiT^ by the tri. ineq. 



(22) < 2^-ME[|A„(r)-A„^*rr] +E[\Y,Ni{T)-nfiT\^] )n-^-^,Ty 

^ 1=1 
by Markov's inequahty and (8). 



W.l.o.g. assuming nT > XnT > 1, it follows from Lemma 5 (applied with n = 1), and the fact that 

An{T) has the same distribution as A(A„T), that there exists CA,r = supj>]^ t~2E[|A(t) — < oo 
s.t. 

(23) E[\Ar,{T) - A„^rr] < CA,r(A„r)5 < CA,.(nr)i. 

Since nT > 1 by assumption, it follows from Lemma 5 that there exist Cg^r < s.t. 

n 

(24) K[\Y^Ni{T) - n^iT\^] < CsAr^T)i. 

i=l 

It follows from (23) and (24) that (22) is at most 

,B 



2^~\CA,r+Cs,r){^^l)-'T- 



Thus we find that 



(25) lim lim 

T->oo 



/ 1 " B \ 

imsupP n-2(A,(r) - ViVi(r)) >--fJiT] = 0. 

1=1 



We now bound (21), which equals fin 2 sup^>o (^n(i) — X]"=i > /"^ ) by stationary incre- 



ments. But as our proof of Theorem 1 demonstrates tightness of {n 2 supt>o (^n(i)~Sr=i ^ii^)) > — 
l|, it follows that 

/ 1 " B \ 

(26) lim limsupP(n^2 sup(A„(t) - VAfi(t)) > — /uT =0. 

T->-oo n-j-oo V t>0 ~^ 2 J 

Using (26) to bound (21), we find that 

(27) lim limsuppf supfn-5(A,(t)- ViV,,(t)) -n-5(A„(r)- ViVi(r))) > ^f^T] =0. 
T^oo n^oo \ t>r V ^ / 2 y 

Combining (25) and (27) completes the proof. □ 

We now complete the proof of Theorem 2. 
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Proof. We first prove the upper bound. By Lemma 7, for any x > 0, we may construct a strictly 
increasing sequence of integers {T^ ^-i, k > 1} s.t. for all k > 1, 



limsupP(n~5 sup {An(t) - Ni{t)) > x] 



<k-\ 



It follows that for all x > and k > 1, 
(28) 



lim sup P { n 2 sup (A„(t)-^iVi(t)) > x) < limsupP(n-^ sup (A„(i)-^ iVi(i)) > x ) +A:-^ 



By the Portmanteau Theorem (see [5]), a sequence of r.v.s {X„,} converges weakly to the r.v. Xoo 
iff for all closed subsets C of M, lim sup„_^Qo P(X„ € C) < P(Xoo G C) iff for all open subsets O of 
M, P(Xoo G O) < hminf„^ooP(^n G O). It follows from (28) and Corohary 2 that for all x > 
and k > 1, 

(29) lim sup PI n~2 sup (A„(i)-ViVi(t)) > X < P sup (^(t)-X'(t)-5/it) > X 

n^oo \ t>0 J \0<t<T^j^_i / 

Note that the sequence of events < sup {•A{t) — V{t) — B^t) > x, /c > 1 > is monotone in k. 



It follows that 



lim P( sup {A{t) -V it) - B^xt) >x] =f( svi^{ A{t) -V{t) - B^it) >x\. 

k^oo Vo<t<T^j^_i J \t>0 J 

It then follows from (29), by letting k — )• 00, that for all x > 0, 

(30) limsuppfn~^sup(A„(t) - ViVi(t)) > x^ < pf sup (^(t) - P(t) - > xV 

n-i-oo V t>0 J \ t>0 J 

From Theorem 3 and (30) we have 

limsupx^^ log I limsupPf ((5"(oo) — n)^n^2 > X I 1 

x^oo \ n— >oo \ / / 

< limsupx"MogP( sup {A{t) - V{t) - Bfit) > x - 1 ) 
\ t>o J 

= lim sup ( (x - 1)"^ log P( sup (Alt) - Vit) - B^d) > x - 1 ) ) 

x^oo X y \t>0 J J 

= -2B{c\ + c|)~^ by Corollary 3.(i), 
which completes the proof of the upper bound. 

We now complete the proof of Theorem 2 by demonstrating that if A is an exponentially dis- 
tributed r.v., then 



(31) 



liminf x"^ log ( liminf Pf ((5"(oo) - n)"^n"5 > x ) ) > -2B(c\ + c|^"^ 

a;— >-oo I n— >oo \ ^ J I 
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Let Zn denote a Poisson r.v. with mean A„. It follows from Theorem 4 that for all x > 0, 
(32) 

liminfPf (Q"(cx)) -n)"^n"5 > x ) > f liminfP(Z„ > n) ) f liminf supP(A„(t) - V iV:j(t) > x) ] . 

n— >oo y ' y y n— >-oo y y n— >oo j>q ■■^-^ 'y 

Recall that G is a normally distributed r.v. with mean and variance 1. Thus by the Central Limit 
Theorem, 

(33) lim P(Z„ > n) = P(G > S). 

n— !>oo 

Note that for any fixed ^(f) — 2^(t) — B[it is a non-degenerate Gaussian r.v., and every x G M is 
a continuity point of the distribution of any non-degenerate Gaussian r.v. It follows from Lemma 
6 and the definition of weak convergence that for any fixed t > and all x > 0, 

n 

lim V(AM) - ^ NAt) > x) =F(A(t) -V(t)-Bfit > x). 

i=l 

Thus for any fixed x > and s > 0, 

n n 

liminf supP(A„(t) NAt) > x) > liminf P(A„,(s) -S^ Ni{s) > x) 

n— >oo i>Q ^ ' ' n— >-oo — ' ' 

— 1=1 i=l 

(34) = ¥{A{s) -V{s) - B^s> x). 

By fixing x > and taking the supremum over all s > in (34), we find that for all x > 0, 

n 

(35) liminfsupP(^„(t) NAt) > x) > sn^WiAit) - Vlt) - B^t > x). 

— 1=1 — 

Combining (32), (33), and (35), we find that the l.h.s. of (32) is at least 

(36) P(G > B) supP(^(t) - V{t) - Bfit > x). 

t>o 

(31) then follows from (36) and Corollary 3.ii. Combining (31) with the first part of Theorem 2, 
which we have already proven, completes the proof. □ 

7. Application to Reed's diffusion limit. In [26], J. Reed resolved the long-standing open 
question, originally posed in [15], of the tightness and weak convergence for the queue length of 
the transient GI/GI/n queue in the H-W regime. However, the associated weak limit (a certain 
diffusion process) is only described implicitly, as the solution to a certain stochastic convolution 
equation (see [26]). Prior to this work, very little was understood about this limiting diffusion 
process. 

In this section we derive the first non-trivial bounds for the weak limit of the transient GI/GI/n 
queue in the H-W regime. Let denote the FCFS GI/GI/n queue with inter-arrival times drawn 
i.i.d. distributed as AX~^, processing times drawn i.i.d. distributed as 5, and the following initial 
conditions. For i = 1, . . . ,n, there is a single job initially being processed on server i, and the set 
of initial processing times of these n initial jobs is drawn i.i.d. distributed as R{S); there are zero 
jobs waiting in queue, and the first inter-arrival time is distributed as R{AX~^), independent of the 
initial processing times of those jobs initially in system. Let Qi (t) denote the unique strong solution 
to the stochastic convolution equation given in [26] Equation 1.1. Then letting Qi(t) denote the 
number in system at time t in Q", it is proven in [26] that 
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Theorem 10. For allT € (0, oo), the sequence of stochastic processes {n 2 (Qi (i)— f^)o<t<T' — 
1} converges weakly to Qi{t)o<t<T in the space L'[0,T] under the Ji topology. 

We now apply Theorem 3 to derive the first non-trivial bounds for proving that 

Theorem 11. For all x > and t>0, 

F{Qi{t) > x) <f( sup {A{s) - V{s) - Bfis) > x] . 

\0<s<t J 

Proof. Note that we may let the arrival process to Q" be An{t). Thus by Theorem 3, for all 
X > and t > 0, 

liminfpfn~^(Q?(t) - n)"^ > < liminf pfn~^ sup - V 7Vi(s)) > 

n^oo \^ ^ 'J n^co \ o<^<4 ^ J 

< limsupP(?T,~5 sup {An{s) -S^Niis)) > x] 

n->oo V 0<s<t J 
— — 1=1 

(37) < PI sup (yA{s) — T>{s) — Bfis) > x] by the Portmanteau Theorem. 

\o<s<t ) 

Again applying the Portmanteau Theorem, it follows from Theorem 10 that for all x > 0, 
(38) P(Qi(t) > 2;) < liminfPf (Q"(t) _ n)+ > x ) . 

Combining (37) and (38) completes the proof. □ 

Theorem 11 implies that Qi{t) is distributionally bounded over time, and thus in a sense stable. 
In particular, for all t >0, Qi {t) is stochastically dominated by the r.v. supj>o {A{t) — 'D{t) — Bfit) . 
Prior to this work, the stability of Qi{t) was not known. 

8. Conclusion. In this paper, we studied the FCFS GI/GI/N queue in the Halfin-Whitt 
regime. We proved that under minor technical conditions the associated sequence of steady-state 
queue length distributions, normalized by n2, is tight. We derived an upper bound for the large 
deviation exponent of the limiting steady-state queue length matching that conjectured in [14] , and 
proved a matching lower bound for the case of Poisson arrivals. We also derived the first non-trivial 
bounds for the diffusion process studied in [26]. 

Our main proof technique was the derivation of new and simple bounds for the FCFS GI /GI /n 
queue. Our bounds are of a structural nature, hold for all n and all times t > 0, and have intuitive 
closed-form representations as the suprema of certain natural processes which converge weakly to 
Gaussian processes. Our upper and lower bounds also exhibit a certain duality relationship, and 
exemplify a general methodology which may be useful for analyzing a variety of queueing systems. 

This work leaves many interesting directions for future research. One pressing question is whether 
or not {n~2 ((^"(00) — n)^, n > 1} has a unique weak limit. Similarly, although Corollary 11 shows 
that the diffusion process Qi{t) is distributionally bounded over time, it is unknown whether Qi{t) 
has a well-defined steady-state distribution. Furthermore, should {n~2 ((^"(oo) — n)^, n > 1} have 
a unique weak limit and Qi{t) have a well-defined steady-state, must the two coincide? We note 
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that similar questions (on the order of fluid, as opposed to diffusion, scahng) were investigated in 
[19]. 

It is an open challenge to extend our techniques to more general models. For example, it would 
be interesting to generalize our lower bounds to non-Poisson arrival processes, as was done in [14] 
for the special case of processing times with finite support. It would also be interesting to generalize 
our bounds to systems with abandonments [GI /GI /n + GI). This setting is practically important, 
as the main application of the H-W regime has been to the study of call-centers, for which customer 
abandonments are an important modeling component [3]. For some interesting steps along these 
lines the reader is referred to the recent paper [10]. 

9. Appendix. 

9.1. Proof of Theorem 5. It is proven in [31] Theorem 1 (given in the notation of [31]) that 

Theorem 12. Suppose that for all sufficiently large n, {Cn,ji^ > 1} is a stationary, count- 
ably infinite sequence of r.v. Let On = IE[(^„^i], and Wn,k = X^i=iCn.,j- Further assume that a„ < 
0, lim„_j>oo o-n = 0, and there exist Ci, C2 < 00 and e > s.t. for all sufficiently large n, 

(i) ^[\Wn,k - A;anP+'] < CiA;i+f for all k > 1; 

(ii) P(maxi=i_..._fc(Wn,i - ia„) > x) < C2^[\Wn,k - A:a.„|2+^] for all k > 1 and x > 0; 
(Hi) F{limk-,ooWn,k = -00) = 1. 

Then supfc>o Ty„,fc, > 1} is tight. 

With Theorem 12 in hand, we now complete the proof of Theorem 5. 

Proof of Theorem 5. The proof follows almost exactly as the proof of Theorem 12 given in 
[31], and we now explicitly comment on precisely where the proof must be changed superficially 
so as to carry through under the slightly different set of assumptions of Theorem 5. First off, 
nowhere in the proof of Theorem 12 given in [31] is assumption (iii) of Theorem 12 used, and thus 
that assumption is extraneous and may be removed. The only other difference between the set of 
assumptions for Theorem 12 and the set of assumptions for Theorem 5 is that assumption (ii) of 
Theorem 12 is replaced by assumption (ii) of Theorem 5. We now show that Theorem 12 holds 

under this change in assumptions. As in [31], let 2;(a„, k) = + 2'^|o„|. Then the only place where 
assumption (ii) of Theorem 12 is used is between Equations 5 and 6, where this assumption is 
required to demonstrate that 

1 * 1 

(39) P(W„ 2* - 2''a„ > -x(a„, k)) + P( max (V Q - ian) > -2;(a„, k)) 

(40) < (1 + C2)Ci22+^2'=(i+f)(x(a„, A:))-('+^\ 

We now prove that assumption (ii) of Theorem 5 is sufficient to derive (40). In particular, the first 
summand of (39) is at most 

E[l^n,2fe - 2^anp+'] (^x(a„, A;))"^^+'^ by Markov's inequality 

(41) < C7i22+^2'=(^+5) (x(an, k)) by assumption (i) of Theorem 5. 
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By the stationarity of {Cn,ji^ ^ 1}) the second summand of (39) equals 

P( max {Wn,i - ian) > l;x{an,k)) 
1=0,. ..,2'= 2 

(42) < C222+^2'=(i+t) (x(a„, k)) by assumption (ii) of Theorem 5. 

Since we may w.l.o.g. take Ci,C2 > 1, it follows that Ci + C2 < (1 + C2)Ci, and thus (40) follows 
from (41) and (42). The theorem follows from the proof of Theorem 12 given in [31]. □ 

9.2. Proof of Lemma 5. We note that the special case r = 2 is treated in [34]. Before proceeding 
with the proof of Lemma 5, it will be useful to prove three auxiliary results. The first treats the 
special case n = l,t > 1 for ordinary (as opposed to equilibrium) renewal processes, and is proven 
in Theorem 1 of [8]. 

Theorem 13. Suppose Z{t) is an ordinary renewal process with renewal distribution X s.t. 
E[X] = ;u~i G (0, 00), and E[X''] < 00 for some r > 2. Then supi>i t^iE[\Z{t) - ixt^] < 00. 

Second, we prove a lemma treating the special case n = 1, t > 1 for equilibrium renewal processes. 

Lemma 8. Under the same definitions and assumptions as Lemma 5, for each r > 2, there 
exists Cx,r < CO (depending only on X and r) s.t. for all t > 1, K[\Zf{t) — /itC] < Cx,rt^ ■ 

Proof. Let X^ denote the first renewal interval in Zf(t), and fx^ its density function, whose 
existence is guaranteed by (1). Observe that we may construct Z^(t) and an ordinary renewal 
process Z{t) (also with renewal distribution X) on the same probability space so that for all t > 0, 
Zf{t) = liX" <t) + Z{{t - X^)+), with Z{t) independent of Thus 

Ztit) - /it = (z((t - XT) - l^{t - X-)+^ + (/(X^ <t)- /x(t -it- x-)+)) . 

Fixing some t > 1, it follows that E[|Zf(t) — /it|^] is at most 

(43) T-^E[\Z{{t - X^) - fi{t - + 

(44) +2''~^E[\L{X^ <t) - fi{t -{t- X^) \^] by the triangle inequality and (8). 
We now bound the term E[|Z((t — X^)'^) — /i(t — X'^)"''!''] appearing in (43), which equals 

(45) f \[\Z{t-s)-^i{t-s)Y]fx^{s)ds+ f E[\Z{t-s)-iJi{t-s)Y]fx^{s)ds. 
Jo Jt-1 

Let C'x r = sup4>i t~2E[|Z(t) — /Lit|^] . Theorem 13 implies that the first summand of (45) is at most 

r ' {C'xA* - sy^)fx4s)ds < f ' {C'x^,ti)fx^{s)ds 
Jo Jo 

= C'x^/^^{X^ <t-l). 

Since t — s <1 implies \Z{t — s) — f.i{t — s)\^ < \Z{1) + /xC, the second summand of (45) is at most 
E[|Z(1) + /i|^]P(X<= e[t- l,t]). Combining our bounds for (45), we find that (43) is at most 

(46) 2'-1e[|Z(1) + //['•] + r-'C'x,,ti. 
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We now bound (44), which is at most 
r-^E[\l{X^ <t)+fi{t-{t-X')+)\'-] < 2^'-^(^l + E[\fi{t-{t-XY)\']^ by (8) 

(47) = 2''''^l^ + ^,'\j\'-fx^{s)ds + j\'-fx^{s)ds)y 

It foUows from (1) and Markov's inequahty that for all s > 0, fx^{s) = /uP(X > s) < ^E[X'^\s~'^ . 
Thus the term fx^{s)ds + fx<^{s)ds appearing in (47) is at most 

/ s''{fiE[X'-]s~'')ds + f {fiE[X'-]s~'')ds = fMiX"-]! / ds + f s-^ds 

= fiE[X''](^t + f{r-l)-H^-''^ 

(48) = /iE[Xn(l + (r-l)-i)t. 

Using (46) to bound (43) and (48) to bound (47) and (44), we find that IE[|Zf(t) -^^r] is at most 

(49) 2'-1e[|Z(1) + /^r] + 2^-^C'x^rt^^ + 22^-2 + 2^'-^ n'-+^E[X'-]{l + (r - l)-^)t. 

Noting that E[|Z(1) + < oo since any renewal process, evaluated at any fixed time, has finite 
moments of all orders (see [22] p. 155), E[X'^'] < oo by assumption, and t < since t > 1 and 
I > 1, the lemma follows from (49). □ 

Third, we prove a lemma which will be useful in handling the case t < 2. We note that in this 
auxiliary lemma, the upper bound is of the form {nty, as opposed to [nt)^ . 

Lemma 9. Under the same definitions and assumptions as Lemma 5, there exists Cx,r < oo 
(depending only on X and r) s.t. for all n > 1, and t G [O, 2] , 



(50) E[\J2z!{t) - fint\''] <Cx,r{l + {nty'). 

i=l 

Proof. Note that the l.h.s. of (50) is at most 

n n 

(51) E[\Y,Zfit) + nnt\^] < r-\E[{Y,Zfit)Y]+if,ntY)hy{8). 

1=1 i=l 

We now bound the term E[( ^^^^ Z?(t))^] appearing in (51). Let {Zi{t)} denote a countably 
infinite sequence of i.i.d. ordinary renewal processes with renewal distribution X. Let us fix some 
t £ [0,2] and n > 1, and let {Bi} denote a countably infinite sequence of i.i.d. Bernoulli r.v. s.t 
F{Bi = I) = p = F{R{X) < t). Note that we may construct {Zf(t)}, {Zi{t)},{Bi} on the same 
probability space so that w.p. 1 Zf{t) < Bi{l + Zi{t)) for all i > 1, with {Zi{t)},{Bi} mutually 

independent. Letting M = Yl^=i -^i; it follows that 

(52) E[(^Zf(t))M]<E[(j;(l + Z,(i))) ]. 

i=l ^ j=l 
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Let denote the set of non- negative integers. Note that for any positive integer A:, 

iE[(E(i + ^.(t)))^'^] = ^{ n(i + W1 

ii+---+ife=H 

(53) = J] JjE[(l + Zi(i))^''] since are i.i.d. r.v.s. 

ii+...+ifc=M 

For any setting of {jj, i = 1, . . . , A;} in the r.h.s. of (53), at most \r\ of the jj are strictly positive, 
and each ji is at most \r\ . It follows that the term ^^=1 + -^i(^))"''] appearing in the r.h.s. of 

(53) is at most ( IE[(1 + Zxii)) ] j , irregardless of the particular setting of = 1, • • • , A:}- 

As there are a total of A;^'"^ distinct feasible configurations for {jj, z = 1, . . . , A;} in the r.h.s. of (53), 
combining the above we find that for any non-negative integer fc, 

K[(E(1 + ^^W))^'^] < A.M(^E[(l + Z,(t))M]y'^ 

(54) < k^'''^ ^E[(l + Zi(2)) ^'■^]^ since by assumption t < 2. 

Since any renewal process, evaluated at any fixed time, has finite moments of all orders (see [22] p. 

E[(l + Zi(2))''^'] J is a finite constant depending only on X and 

[r]. Combining (52) and (54) with the independence of M and {Zi{t)}, it follows from a simple 
conditioning argument that 

n 

(55) E[(E^fW)^'V^^i,HlE[MM]. 

i=l 

We now bound the term E[ilfr^T] appearing in (55). Noting that M is a binomial distribu- 
tion with parameters n and p, it follows from [27] Equation 3.3 that there exist finite constants 

Co, \r] , Ci^ \r] , p,.] , • • • , C^r] , [r] , independent of n and p, s.t. E [M M ] =Yltlo ^fc, ifjZl {n - j) ■ 

Further noting that W)zl{n - j) < for all A; > 0, it follows that E[mM] < Y^^lo \Ck,\r-\\{npf ■ 

Letting Cp^-| = maXj=o,...,[r] jCj^r]!, it follows from (55) that 

1=1 j=0 

(56) < Ci,^,^Cf,^([rl+l)(l + np)r^l 



Recall that for any non-negative r.v. Y, one has that E[y''] < E[yr'"T]T^. Thus letting 

r 

M 



A 



Cx^rl^f^l (H + 1)J ' it follows from (56) that 

n 

(57) E[(E^f(i))1 <Ci,,(l + np)^ 
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Furthermore, it follows from (1) that p = fj, F{X > y)dy < fit. Combining with (57), we find that 

n 

(58) E[{J2z!{t)Y]<Cl,{l + fintY 

1=1 

Plugging (58) back into (51), it follows that the l.h.s. of (50) is at most 

2'-^ f ci ,(1 + fifity + ifinty) < 2^cjc . + i)(i + f^my. 



Noting that (1 + finty < 2'' {l + (finty) by (8), and 1 + {finty < (1 + fiy{l + {nty), completes 
the proof. □ 

With the above auxiliary results in hand, we now complete the proof of Lemma 5. 

Proof of Lemma 5. We proceed by a case analysis. First, suppose t < ^. Then we also have 
t <2, and by Lemma 9 there exists Cj^^, < oo s.t. the l.h.s. of (9) is at most 

Cj^.,{l + (nty) < Cjf ,,(l + 2'~) since t < ;^ implies < 2. 

Letting Mi = Cj^,,(l + 2*"), it follows that the l.h.s. of (9) is at most Mi < Mi(l + (nt)i), com- 
pleting the proof for the case t < ^. 

Second, suppose t G Let ni{t) = [nt\. Noting that t > ^ implies ni{t) > 0, in this 

case we may define n2{t) = L;if(tyJ' Then the l.h.s. of (9) equals 

ni{t)n2{t) n 

^[\ E E (^(m-i)n.w+/W - /^O + E (^f w - /^*) 11 

m=l 1=1 l=ni{t)n2{t)+l 
ni{t) n2{t) 

(59) < 2-lE[| (^(rn-Dn.W+^i) -^*)r] 

m=l 1=1 
n 

(60) +2'^-^E[| Y i^ii^) - '"^)r] by the and (8). 

I=ni{t)n2{t)+1 

We now bound (59). By Lemma 4, there exists Cr- < oo s.t. (59) is at most 

n2{t) 



1=1 



(61) 



< 2'-^Cr(ni(t))i ^C^,r(^l + {n2{t)ty'^^ by Lemma 9, since t < 2. 



We now bound the term tn^if) appearing in (61). In particular, 
(62) < A < 



\nt\ nt — 1 

27 



But since t > ^ imples nt > 2, and g{z) = is a decreasing function of z on (l,oo), it follows 
from (62) that 

tn2it) < 2. 

Since ni{t) < nt, it thus follows from (61) that (59) is at most 

(63) 2'-iaCi,,(l + 2")(nt)5. 

We now bound (60). Note that the sum Yl?=ni{t)n2{t)+i i^li^) ~/^*) appearing in (60) is taken over 
n — ni(t)n2{t) terms. Furthermore, 

Tl 

n-ni{t)n2{t) = n - ni{t)[ — --J 

ni{t) 

Til 

< n-ni{t){—--l) 
ni[t) 

= ni(t). 

As ni{t) < nt, it thus follows from Lemma 4 that (60) is at most 

2'-ia(nt)5E[|Zf(t) -/xtr] < 2'^^^Cr{nt)m[{Zf{t) + fity] 

(64) < 2'^^^Cr{nt)m[{Zf{2) + 2//)''] since t < 2. 

Using (63) to bound (59) and (64) to bound (60) shows that the l.h.s. of (9) is at most 

(65) 2"-iaci^,(l + 2")(nt)5 + 2'^"^a(nt)5E[(Zf (2) + 2/x)"] . 

Let M2 = 2''-^CrCj^,^{l + 2'') + r-'^CrE[{Zf{2) + 2/i)''] . It follows from (65) that the l.h.s. of (9) 
is at most M2{nt)2 < M2(l + {nt)^^ completing the proof for the case t G [f' ^] • 

Finally, suppose t > 2. In this case, it follows from Lemma 4 that the l.h.s. of (9) is at most 

Crn^K[\Zf{t) - Let C^^^ = supi>2 t"5E[|Zf (t) - fit\'']. Then it follows from Lemma 8 that 

Cxj. < oo, and the l.h.s. of (9) is at most CrC\ ^{nt)i . Letting M3 = CrC\^, it follows that the 
l.h.s. of (9) is at most M^{nt)'^ < M^{l + (71.^)2)^ completing the proof for the case t >2. 

As this treats all cases, we can complete the proof of the lemma by letting M4 = max (Mi, M2, M3) , 
and noting that for all n > 1 and t >0, the l.h.s. of (9) is at most M^l^l + {nt)^y □ 
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